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AUTOMATIC HEIGHT ADJUSTMENT FOR 
ELECTRONIC HIGHLIGHTER PENS AND MOUSING DEVICES 

5 Field of the Invention 

The present invention generally relates to methods and systems for entering and 
manipulating data in a computing environment. More particularly, the present invention relates 
to automatically adjusting the cursor height for electronic input modes such as electronic pens 
and electronic mousing devices. 

10 Background of the Invention 

Since the advent of the computer age, hardware and software systems have been 
developed for allowing users to efficiently enter and manipulate text and data that is displayed on 
a computer-generated display. In the early days of computing, users were primarily restricted to 
manipulating displayed text and data through a variety of keyboard strokes. The advent of 

15 mousing devices, including keyboard touch pads, gave users enhanced access to displayed data 
by allowing users to freely move a mouse pointer or cursor about displayed information for 
selecting data for manipulation or input. Recently, a variety of pen and ink systems have been 
developed that allow users to select and manipulate displayed text and data, as well as allow 
users to write electronically in free-form fashion by touching an electronic pen to the computer 

20 display screen. 

Many modem computer systems are hybrids between tablets allowing only pen input and 
traditional computers allowing only keyboard or mouse input. Such hybrid systems allow data 
input and manipulation via keyboards, mousing devices, and electronic pen devices. Among the 
data input and manipulation enabled by such systems is highlighting. That is, many such 
25 systems allow mousing devices or electronic pens to act as highlighting pens so that a user may 
highUght text or images of an electronic document by dragging a mouse cursor or electronic pen 
tip across desired text and images. Unfortimately, prior systems do not account for the varying 
sizes of typed text, handwritten text or images. For example, a document may contain typed text 
that varies in font size, handwritten text of various sizes and images of varying sizes. If the user 



desires that the highlighter color height match the height of the text or images to be highlighted, 
the user must manually change the cursor height for the mouse cursor or electronic pen for each 
text or image selection to be highUghted. Accordingly, there is a need for a method and system 
for automatically adjusting the cursor height for electronic highlighters to a desirable height 
5 relative to typed or handwritten text or images to be highlighted. It is with respect to these and 
other considerations that the present invention has been made. 



Summary of the Invention 

Embodiments of the present invention solve the above and other problems by providing 
for automatic adjustment of electronic highUghter ink or cursor height in response to a 
10 determined height of typed or handwritten text or images to be highlighted. Generally described, 
the highUghter ink height or cursor height of an electronic highlighter, such as an electronic pen 
or mousing device, automatically adjusts based on the text or images the user is highlighting. 
When the user focuses the electronic highlighter on text or images to be highlighted, the height 
of the text or image is determined, and the height of the highlighter cursor is adjusted. 
15 According to aspects of the invention, a user selects a highlighting function so that the 

user's electronic pen or mousing device will function as an electronic highlighter. When the user 
touches the electronic pen to a particular text or image, or hovers the mousing device cursor over 
a particular text or image selection, the height of the text or image selection is determined. 
According to one aspect of the invention, the height is determined from the font size of typed 
20 text or from the height of handwritten text. According to another aspect of the invention, the 
highlighter height is determined from the average height of typed or handwritten characters 
without including the length of ascending or descending character segments. According to 
another aspect of the invention, the highlighter height is determined from the maximum height of 
typed or handwritten characters mcluding the length of ascending or descending character 
25 segments. According to yet another aspect of the invention, if the user's display screen is in rule 
line mode, the distance between rule lines is adopted as the highlighter cursor height. 

Once the highlighter cursor height is determined, that height is set for the highlighter 
cursor so that highlighter color or ink is drawn onto the computer-generated page during the 
duration of a given highUghter (electronic pen or mousing device) stroke. If the user Ufts the 



electronic pen from the page, or otherwise disengages the highlighter device, the determined 
height is discarded. If the user begins a subsequent highlighting action, determination of the 
highlighter cursor height is repeated for the subsequent highUghting action. 

These and other features and advantages, which characterize the present invention, will 
5 be apparent from a reading of the following detailed description and a review of the associated 
drawings. It is to be understood that both the foregoing general description and the following 
detailed description are exemplary and explanatory only and are not restrictive of the invention 
as claimed. 

Brief Description of the Drawings 

10 Fig. 1 is a block diagram showing the architecture of a personal computer that provides 

an illusfrative operating environment for embodiments of the present invention. 

Fig. 2 is a simplified diagram illusfrating a computer screen display adapted for use with 
an elecfronic pen and showing a computer keyboard and associated input devices. 

Fig. 2B is a simpUfied diagram illustrating an actual operation of embodiments of the 
1 5 present invention for highlighting a plurality of text selections. 

Fig. 3 is a simplified diagram illustrating a computer screen display adapted for use with 
an electronic pen and showing a computer keyboard and associated input devices where the 
computer screen display is set in rule line mode. 

Fig. 4 is a flow diagram showing an illustrative routine for automatically adjusting an 
20 elecfronic highlighter cursor height relative to typed or handwritten text or images to be 
highUghted. 

Detailed Description of the Preferred Embodiment 

As briefly described above, embodiments of the present invention are dfrected to 
methods and systems for providing automatic adjustment of elecfronic highlighter cursor height 
25 in response to a determined height of typed or handwritten text or in response to a determined 
height of a computer-displayed object. In the foUowmg detailed description, references are made 
to the accompanying drawings that form a part hereof, and in which are shown by way of 
illustrations specific embodiments or examples. These embodiments may be combined, other 



3 



embodiments may be utilized, and structural changes may be made without departing from the 
spirit or scope of the present invention. The following detailed description is therefore not to be 
taken in a limiting sense and the scope of the present invention is defined by the appended claims 
and their equivalents. 

5 Referring now to the drawings, in which like numerals represent like elements through 

the several figures, aspects of the present invention and the exemplary operating environment 
will be described. Fig. 1 and the following discussion are intended to provide a brief, general 
description of a suitable computing environment in which the invention may be implemented. 
While the invention will be described in the general context of program modules that execute in 

10 conjunction with an application program that runs on an operatmg system on a personal 
computer, those skilled in the art will recognize that the invention may also be implemented in 
combination with other program modules. 

Generally, program modules include routines, programs, components, data structures, 
and other types of structures that perform particular tasks or implement particular abstract data 

15 types. Moreover, those skilled in the art will appreciate that the invention may be practiced with 
other computer system configurations, including hand-held devices, multiprocessor systems, 
microprocessor-based or programmable consumer electronics, minicomputers, mainframe 
computers, and the like. The invention may also be practiced in distributed computing 
environments where tasks are performed by remote processing devices that are linked through a 

20 communications network. In a distributed computing environment, program modules may be 
located in both local and remote memory storage devices. 

Turning now to Fig. 1, an illustrative computer architecture for a personal computer 2 for 
practicing the various embodiments of the invention will be described. The computer 
architecture shown in Fig. 1 illustrates a conventional personal computer, including a central 

25 processing unit 4 ("CPU"), a system memory 6, including a random access memory 8 ("RAM") 
and a read-only memory ("ROM") 10, and a system bus 12 that couples the memory to the 
CPU 4. A basic input/output system containing the basic routines that help to transfer 
infomiation between elements within the computer, such as during startup, is stored in the ROM 
10. The personal computer 2 fiirther includes a mass storage device 14 for storing an operating 

30 system 16, application programs, such as the application program 205, and data. 



The mass storage device 14 is connected to the CPU 4 through a mass storage controller 
(not shown) connected to the bus 12. The mass storage device 14 and its associated computer- 
readable media, provide non-volatile storage for ttie personal computer 2. Although the 
description of computer-readable media contained herein refers to a mass storage device, such as 
5 a hard disk or CD-ROM drive, it should be appreciated by those skilled in the art that computer- 
readable media can be any available media that can be accessed by the personal computer 2. 

By way of example, and not limitation, computer-readable media may comprise 
computer storage media and conmiunication media. Computer storage media includes volatile 
and non-volatile, removable and non-removable media implemented in any method or 
10 technology for storage of information such as computer-readable instructions, data structures, 
program modules or other data. Computer storage media includes, but is not limited to, RAM, 
ROM, EPROM, EEPROM, flash memory or other solid state memory technology, CD-ROM, 
DVD, or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other 
magnetic storage devices, or any other medium which can be used to store the desired 
1 5 information and which can be accessed by the computer. 

According to various embodiments of the invention, the personal computer 2 may 
operate in a networked environment using logical connections to remote computers through a 
TCP/IP network 18, such as the Internet. The personal computer 2 may connect to the TCP/IP 
network 18 through a network interface unit 20 connected to the bus 12. It should be appreciated 
20 that the network interface unit 20 may also be utilized to connect to other types of networks and 
remote computer systems. The personal computer 2 may also include an input/output 
controller 22 for receiving and processing input from a number of devices, including a keyboard 
or mouse (not shown). Similarly, an input/output controller 22 may provide output to a display 
screen, a printer, or other type of output device. 
25 As mentioned briefly above, a number of program modules and data files may be stored 

in the mass storage device 14 and RAM 8 of the personal computer 2, including an operating 
system 16 suitable for controlUng the operation of a networked personal computer, such as the 
WINDOWS operating systems from MICROSOFT CORPORATION of Redmond, Washington. 
The mass storage device 14 and RAM 8 may also store one or more application programs. In 
30 particular, the mass storage device 14 and RAM 8 may store an appUcation program 205 for 

5 



creating and editing an electronic document 24. For instance, the application program 205 may 
comprise a word processing application program, a spreadsheet application, a contact 
application, and the like. Other applications illustrated in Fig. 1 and appUcable to embodiments 
of the present invention include the word processing application 220, the calendar application 

5 225 and the electronic mail application 26. 

As briefly described above, embodiments of the present invention allow for automatic 
adjustment of electronic highlighter cursor or ink height in response to a determined height of 
typed or handwritten text or in response to a determined height of a computer-displayed object. 
Referring to Fig. 2, a computer screen display 200 is illustrative of a computer screen display for 

10 a conventional personal computer, a tablet type computer, a personal digital assistant, or any 
other electronic device that allows for the display of text or data and that allows for interaction 
between a user and the screen via an electronic pen 210. As shown in Fig. 2, an electronic 
pen 210 is illustrated touching the surface of the screen 205. As is known to those skilled in the 
art, electronic pen and ink systems such as illustrated in Fig. 2 allow a user to utiUze the 

15 electronic pen 210 to write in free-form text on the screen 205, allow the user to markup text 
previously entered using a keyboard or an electronic pen, and allow the user to select data 
displayed on the screen 205 for applying some type of functionality. Mechanisms for operation 
of electronic pen and ink systems with computer screen displays, such as illustrated in Fig. 2, are 
well known to those skilled in the art. 

20 In addition to the electronic pen 210, a keyboard 215 and an associated mouse 225 are 

illustrated. Mousing devices such as the mouse 225 are well known to those skilled in the art for 
allowing a user to move a cursor about the computer display screen 205, select and searching 
points for inserting text and data, select text or data for applying formatting or other 
functionality, and the like. Li accordance with embodiments of the present invention, the 

25 electronic pen 210 and the mousing device 220 may be selectively placed into highlighter mode 
for allowing a user to highlight text or images on the screen 205 by dragging the tip of the 
electronic pen 210 across the screen 205 or by moving a mouse cursor across the screen 205 by 
movement of the mouse 220. Accordingly, the electronic pen 210 and the mousing device 220 
may be used electronically in a fashion similar to the use of a manual highlighting pen where a 
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user may drag the tip of a highlighting pen across a sheet of paper to distribute highUghting ink 
across the paper and onto text or images that the user wishes to highlight. 

Referring still to Fig. 2, a first text selection 225 is illustrated including a typed sentence 
that is typed in 12-point font. The highlighter pen 210 is illustrated in highlighter mode and is 

5 illustrated as highlighting the words "selection in" 230 contained in the text selection 225. A 
second text selection 235 is illustrated typed in 14-point type, and the electronic pen 210 is 
illustrated as highlighting the words "selection in" 240 of the text selection 235. A handwritten 
text selection 245 is illustrated, and the electronic pen 210 is illustrated as highlighting the word 
"selection" 250 of the text selection 245. As illustrated in Fig. 2, the text selections 225 and 235 

10 are both typed text selections, but are of varying heights because the text selection 235 has been 
entered in 14-point type. The text selection 245 is also of a varying height relative to the text 
selections 225 and 235 because the text selection 245 has been entered by handwriting on the 
screen 205 using the electronic pen 210 in pen mode. 

Fig. 2B illustrates an actual operation of embodiments of the present invention for 

15 varying the highlighter cursor or ink height relative to the height of an object such as typed or 
handwritten text. A typed text selection 265 comprising the word "Text" is highUghted with 
highlighter ink 270 at a height adjusted for the height of the text selection 265. When the user 
moves the pen 210 to the handwritten text selection 275, the highlighter cursor or ink height 
automatically adjusts so that the ink 280 covers the height of the handwritten text selection 275. 

20 As illustrated in Fig. 2B, the electronic pen 210 acts in a similar manner as a manual highUghter 
pen with ink that matches the height of text or objects being highUghted. For example, ink 
flowing from a manual highlighter pen may be "wavy" according to the user's pen stroke. 
Likewise, the electronic highlighting ink 270, 280 rendered by stroke of the electronic pen 210 is 
displayed according to the user's pen stroke, including "waviness" associated with the user's 

25 natural pen stroke. That is, the electronic ink flows wherever the user drags the electronic pen, 
but importantly, the height of the ink is adjusted to the height of the text or object being 
highUghted. As will be discussed below, according to an embodiment of the invention, the 
adjusted ink height remains at an adjusted height imtil the user finishes a given pen stroke and 
Ufts the pen or otherwise disengages the highlighting action. 
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Referring to Fig. 3, a computer screen display 300 is illustrated wherein a user has 
selected the display in rule line mode. That is, by selecting rule line mode, a plurality of rule 
lines 312 are displayed on the computer screen display 300 for giving the computer screen 300 
an appearance of a rule lined notepad page or paper. A typed text selection 310 is illustrated 
5 having a highUghted section 315 wherein the words "a text" have been highlighted by the 
electronic pen 210. A handwritten text selection 320 is illustrated having a highlighted 
section 325 wherein the word "handwriting" has been highlighted by the electronic pen 210 after 
the electronic pen 210 has been selectively placed into highUghter mode. As will be described 
below with reference to Fig. 4, the highUghter cursor height may be set to the distance between 

1 0 the given pair of rule lines 312. 

Referring back to the handwritten text selection 245, illustrated in Fig. 2, the general 
height 255 of the handwritten text selection is illustrated. According to embodiments of the 
present invention, the general height 255 of the handwritten text selection is determined by 
ignoring the lengths of ascending and descending character segments such as the looped tail of 
15 the character "g" in the word "handwriting." As will be described with reference to Fig. 4 
below, according to one embodiment of the present invention, the proper highUghter cursor 
height for use with a handwritten text selection such as the selection 245 may be adjusted to the 
general height 255 of the handwritten text selection. Alternatively, the highlighter cursor height 
may be adjusted to the maximum height 260 of tiie handwritten text selection, including the 
20 lengths of ascending and descending character segments such as the looping tail of the character 
"g" of the word "handwriting." For determining the general height 255 of a handwritten text 
selection 245, methods may be used whereby a determination is made as to the height associated 
with the statistically significant text input. For example, for the text selection 245, the general 
height 255 of the word "handwriting" may be determined by considering the maximum height of 
25 text input for writing the word "handwriting" without consideration of ascending and descending 
character segments such as the top of the letter "t" and the looping tail of the letter "g". For a 
detailed discussion of methods and systems for determining the general height 255 of 
handwritten text such as the handwritten text selection 245, see United States Patent Application 
entitled "Writing Guide For A Free-Form Document Editor, Serial Number 10/186,388, File 
30 June, 28, 2002, which is incorporated herein by reference as if fully set out herein. 
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Fig. 4 is a flow diagram showing an illustrative routine for automatically adjusting an 
electronic highlighter cursor height relative to computer-displayed objects, such as typed or 
handwritten text or images, to be highlighted. The routine 400 begins at start block 405 and 
proceeds to block 410 where a user selects a highlighting functionality for utiUzing the electronic 
pen 210 or mousing device 220 as an electronic highlighter. For purposes of illustration, 
consider for example that the user desires to highlight a portion of the 12-point type text 
selection 225. a portion of the 14-point type text selection 235, a portion of the handwritten text 
selection 245, illustrated in Fig. 2, and the user also desires to highlight a portion of the text 
selection 310 illustrated in Fig. 3. At block 415, the user places the tip of the highlighter pen 210 
or places the mouse cursor of the mouse 220 over the desired text to be highUghted. For 
example, referring to Fig. 2, the user may place the tip of the electronic pen 210 at the beginning 
of the words "selection in" contained in the text selection 225 for purposes of dragging the tip of 
the electronic pen across the words "selection in" for highlighting those words. At block 420, a 
determination is made as to the Une height of the portion of the text selection to be highUghted. 
For example, at block 420, the line height of the words "selection in" is determined for 
automatically adjusting the cursor height of the highlighter ink to be distributed onto the display 
205 as the user drags the tip of the electronic pen 210 across the words "selection in." 

According to embodiments of the present invention, it is desirable that the cursor height 
or the height of the electronic ink that is distributed onto the display screen 205 by the 
highlighter pen 210 be automatically adjusted to the height of the typed or handwritten text 
selection to be highlighted. That is, as shown in Fig. 2, the height of the typed text selection 230 
is smaller than the height of the text selection 240. Similarly, the height of the handwritten text 
selection 245 also varies relative to the two typed text selections. It is desirable that the cursor 
height or height of the electronic pen highhghter ink be adjusted so that the user is able to 
highlight the full height of the typed or handwritten text as the user drags the tip of the electronic 
pen 210 across the text selection to be highlighted. 

Referring still to Fig. 4, the determination of the line height of the text selection to be 
highlighted at block 420 may be determined according to a number of alternative embodiments. 
According to a first embodiment, the routine moves to block 425 and the height of a typed text 
selection such as the text selection 230, 240 may be determined from the font size used for 



displaying the text selection. For example, the text selection 225 illustrated in Fig. 2 is displayed 
in a 12-point type. The text selection 235 illustrated in Fig. 2 is displayed in a 14-point type. 
Because the font sizes (12 point versus 14 point) of the two text selections may be readily 
determined, the line height of those text selections may likewise be readily determined for 
5 adjusting the height of the highlighter cursor for use in highlighting a portion of the text 
selection. 

After a determination of the height of the typed text selection is performed, the routine 
moves to block 430, and a determination is made of the height of a handwritten text selection 
such as the handwritten text selection 245. That is, if the user places the tip of the electronic pen 

10 210 onto a handwritten text selection 245, a determination of the general height 255 of the 
handwritten selection may be performed, as described above. Accordingly, the determined 
general height 255 of the handwritten text selection to be highlighted may be adopted as the 
height of the highUghter cursor for use in highlighting the handwritten selection, such as the 
highlighted portion 250 of the handwritten selection 245 illustrated in Fig. 2. 

15 According to an alternative embodiment, the cursor height for highlighting the 

handwritten text selection 245 may be determined by calculating the maximum height of the 
handwritten selection to be highlighted, including the height of ascending and descending 
character segments such as the looping tail of the character "g" of the word "handwriting" 
illustrated in Fig. 2. Accordingly, a cursor height calculated in this manner will be slightly 

20 higher than many of the characters in a given text selection such as the word "selection" 
illustrated in the text selection 245 of Fig. 2, but the cursor height will be high enough to ensure 
the user that the electronic ink flowing from the electronic highlighter pen 210 may cover all of 
the handwritten text selection to be highlighted. 

According to an altemative embodiment of the present invention, the electronic cursor 

25 height may be determined from the distance between rule lines displayed on a computer screen 
display 300 displayed in rule line mode. According to this embodiment, the routine 400 
proceeds to block 435, and a determination is made as to the distance between rule lines 312 of 
the display screen 300 between which a text selection has been entered where the text selection 
contains a portion of text to be highlighted by the user. That is, if the user touches the tip of the 

30 electronic pen 210 to a portion of the text selection 310 illustrated between the rule lines 312 of 
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the computer screen display 300, a determination is made as to the distance between the rule 
lines containing the text selection to be highlighted. Accordingly, the distance between the rule 
lines is adopted as the height of the cursor height, and the cursor height is automatically adjusted 
to that distance. When the user drags the tip of the electronic pen 210 across the text 

5 selection 310, the height of the highlighter cursor is automatically adjusted to a height equal to 
the distance between the rule lines so that the user may highlight a portion of the text such as the 
portion 315 containing the words "a text" illustrated in Fig. 3. As should be understood by those 
skilled in the art, the methods described herein are equally applicable to highlighting an image 
drawn on or copied to the display screen 205 by determining the height of the drawn or copied 

10 image and by automatically adjusting the highlighter cursor height to the height of the image to 
allow the user to distribute highUghter ink onto the image at a height equal to the height of the 
image. 

Once the desired cursor height is determined, as described above for one of the 
alternative embodiments, the routine proceeds to block 445, and the cursor height is set to the 

15 determined height. At block 450, the user is free to draw highlighter ink at the determined height 
across the display screen 205 and across desired typed or handwritten text selections in order to 
highlight those selections. Once the user has highlighted all desired typed or handwritten text, 
the user may disengage the highlighting action by lifting the electronic pen 210 from the display 
screen 205, or by selectively placing the electronic pen 210 or the mousing device 220 out of 

20 highlighter mode. If the electronic pen 210 or mousing device 220 is still in highlighter mode, 
the user may begin a second highlighting action by placing the tip of the electronic pen 210 or 
the mouse cursor onto or over a different text selection, and an automatic adjustment of the 
cursor height will be performed to adjust the cursor height to the height of the second text 
selection to be highlighted. That is, if the second text selection to be highlighted by the user is 

25 higher than the previous text selection, the cursor height is automatically adjusted to the height of 
the second text selection, as described herein. The user may disengage from the highlighting 
mode by lifting the electronic pen 210 from the display screen 205, or by selectively placing the 
electronic pen 210 or mousing device 220 out of highlighter mode. The routine ends at block 
495. 
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As described herein, methods and systems are provided for automatically adjusting 
electronic highlighter cursor height in response to a determined height of typed or handwritten 
text or to a determined height of images to be highlighted on a computer-generated display 
screen. It will be apparent to those skilled in the art that various modifications or variations may 
5 be made in the present invention without departing from the scope or spirit of the invention. 
Other embodiments of the present invention will be apparent to those skilled in the art from 
consideration of the specification and practice of the invention disclosed herein. 
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